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16.  Abstract 

A four-part  dynamic  simulation  using  two  systems  of  navigation,  area  navigation 
(RNAV)  and  very  high  frequency  omnidirectional  radio  range  (VOR) , was  conducted 
using  the  Digital  Simulation  Facility  (DSF)  at  the  National  Aviation  Facilities 
Experimental  Center  (NAFEC) . The  objectives  were  to:  (1)  validate  the  results  de- 
rived from  fast-time  simulation  tests  of  RNAV  and  Jet-VOR  route  structures  through 
real-time  simulation  tests,  (2)  determine  whether  benefits  resulted  from  the  appli- 
cation of  RNAV  in  the  high-altitude  enroute  environment,  and  (3)  establish  the 
Impact  that  the  number  of  potential  aircraft  conflict  situations  has  on  the  ATC 
system  and  system  user.  Simulations  were  conducted  in  a fast-time  mode,  without 
controller  Intervention,  for  an  area  encompassed  by  five  high-altitude  Chicago  Air 
Route  Traffic  Control  Center  (ARTCC)  sectors  and  for  a single  selected  sector  of 
the  five.  Real-time  simulations,  with  controller  Intervention,  were  conducted  for 
both  the  five-  and  one-sector  configurations. />^ Test  results  showed  that  there  was  a 
Ignlflcant  reduction  in  controller  workload  in  the  RNAV  system  conq>ared  to  the  VOR 
ystem  for  both  sector  configurations,  and  th^t  correlation  was  found  to  exist 
etween  the  Lincoln  Laboratory  and  NAFEC  fast-time  simulation  potential  conflict 
ata.  Comparison  of  the  fast-time  potential  conflict  data  with  real-time  controller 
orkload  and  system  performance  measures  did  not  show  any  correlation  between  the 
wo  sets  of  data.  The  data  from  the  real-time  simulations  showed  major  variations 
etween  runs  of  the  same  traffic  sample,  thus  precluding  the  isolation  of  any 
osslble  Impact  from  variations  in  number  of  potential  conflicts. 
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INTRODUCTION 


PURPOSE.  I 

The  general  purpose  of  this  simulation  was  to  appraise  the  merits  of  fast-time 
simulation  tests  with  real-time  simulation  teats  In  a high-altltude  enroute 
air  traffic  control  center  (ARTCC)  environment.  The  specific  simulation 
objectives  were: 

1.  To  corroborate,  enforce,  and/or  qualify  the  results  derived  from  fast- 
time simulation  tests  of  area  navigation  (^AV)  and  Jet-VOR  (very  high  frequency 
omnidirectional  radio  range)  route  structures  through  real-time  simulation  tests. 

2.  To  determine  whether  or  not  system  benefits  and/or  Impact  may  result 
from  the  application  of  RNAV  In  the  hlgh-altltude  enroute  environment. 

I 3.  To  establish  the  Impact  that  the  number  of  potential  aircraft  conflict 

situations  found  In  fast- time  simulations  (of  given  traffic  samples,  route 
structures,  and  geographic  areas  In  vdilch  controller  Intervention  Is  not 
Introduced)  has  on  the  following  components  when  the  same  conditions  (traffic 
samples,  route  structures,  and  geographic  areas)  are  simulated  In  real-time 
with  controller  Intervention:  system  capacity,  controller  workload,'  and  user 
benefits. 

BACKGROUND. 

The  term,  area  navigation  (RNAV) , specifies  a method  of  navigation  that  permits 
aircraft  operations  on  any  desired  course  within  the  coverage  of  station- 
reference  navigation  signals  or  within  the  limits  of  self-contained  system 
capability  (Federal  Air  Regulations  (FAR) , Part  1) . 

The  Initial  studies  of  hlgh-altltude  enroute  applications  of  RNAV  routes  used 
data  generated  by  Lincoln  Laboratory,  Bedford,  Massachusetts.  These  studies 
were  conducted  In  a fast- time  simulation  mode.  Their  results  Indicated  that 
the  use  of  RNAV  had  a significant  advantage  for  both  user  and  air  traffic 
control  systems  In  terms  of  reduced  potential  conflicts.  Since  these  tests 
were  In  a fast-time  mode,  controller  Intervention  was  not  simulated.  Therefore, 
it  was  determined  that  an  air  traffic  control  (ATC)  real-time  simulation  which 
Included  controller  intervention  was  required  to  calibrate  the  fast-time 
simulation  results. 

The  Area  Navigation  Program  Flan,  FAA-ED-04-02,  September  1974,  described 
the  research  and  development  efforts  required  In  support  of  the  FAA/Industry 
Area  Navigation  Task  Force  Report,  February  1973.  The  research  and  development 
efforts  Included  a series  of  real-time  ATC  simulation  tests  which  would  extend 
over  a period  of  several  years.  An  outgrowth  of  the  simulation  studies  would 
be  the  comparison  of  fast-  and  real-time  simulation  results.  The  resultant 
comparison  would  serve  to  validate  the  results  of  previous  fast-time  studies. 
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DISCUSSION 


GENERAL. 

The  use  of  RNAV  and  Jet-VOR  route  structures  In  an  ARTCC's  area  was  tested  in 
simulation  at  the  National  Aviation  Facilities  Experimental  Center  (NAFEC) 

Atlantic  City,  New  Jersey.  The  testa  used  the  Digital  Simulation  Facility 
(DSF)  to  obtain  both  fast-  and  real-time  simulation  results.  The  fast-time 
tests  were  performed  in  a nonintervention  mode  (without  controller  interven- 
tion) , while  the  real-time  tests  Incorporated  controller  intervention 
capabilities. 

For  both  the  fast-time  and  real-time  simulations,  two  configurations  were 
used.  The  first  configuration  consisted  of  five  sectors  approximating  the 

areas  and  contours  of  five  hlgh~sltltude  sectors  of  the  Chicago  ARTCC  as  shown  I 

in  figure  1.  The  sectors  are  identified  as  sectors  9,  13,  14,  28,  and  29.  ! 

The  second  configuration  consisted  of  sector  28  only.  These  sectors  were 

selected  for  simulations  due  to  the  wide  range  in  potential  conflicts  detected  ! 

in  the  previous  Lincoln  Laboratory  fast-time  simulations. 

Care  was  taken  in  the  development  of  traffic  samples  (including  such  considera- 
tions as  aircraft  type  and  performance,  cruise  altitude,  and  volume)  to  Insure, 
to  the  highest  degree  possible,  that  both  RNAV  and  VOR  system  traffic  were  the 
same  as  that  which  entered  or  departed  from  these  selected  sectors  during  the  j 

previous  Lincoln  Laboratory  tests.  In  addition,  VOR  routes,  direct  fllghtpaths, 

RNAV  routes,  and  distribution  of  traffic  over  the  routes  used  in  the  NAFEC 

simulations  duplicated,  to  the  maximum  extent  possible,  the  conditions  simu-  • i 

lated  by  Lincoln  Laboratory.  To  insure  this  compatibility,  traffic  sample 

and  route  structure  data  previously  stored  on  computer  tape  for  use  by  Lincoln  j 

Laboratory  were  extracted  and  processed  for  the  NAFEC  simulations.  (Refer 

to  appendix  A.)  | 

Two  conditions  were  tested  in  the  fast-  and  real-time  simulations  of  both  j 

the  five-  and  one-sector  configurations.  Under  one  condition,  all  traffic  1 

flew  via  the  Jet-VOR  routes  and  direct  fllghtpaths  shown  in  figures  2 and  4.  j 

Under  t*-  cher  condition,  all  traffic  flew  via  the  RNAV  routes  shown  in 

figures  j and  5 with  a few  exceptions.  These  exceptions  were  caused  by  the  i 

RNAV  structure  used. 

The  RNAV  structure  was  designed  by  NAFEC  previously  for  use  in  a study  of 
RNAV  route  design  concepts  and  was  one  of  a series  used  at  Lincoln  Laboratory 
in  their  fast-time  simulations  (reference  1).  This  RNAV  design  was  not  inten- 
ded to  accommodate  traffic  between  all  city  pairs.  While  all  major  traffic 
flows  were  accommodated  by  the  RNAV  structure,  there  was  a limited  number 
of  flights  between  some  city  pairs  for  which  RNAV  routes  were  not  considered 
in  the  design.  To  accommodate  this  traffic  in  both  the  Lincoln  Laboratory  and 
NAFEC  simulations,  certain  Jet-VOR  and  direct  routes  were  retained,  and  all 
other  non-RNAV  routes  were  deleted  under  simulation  of  the  "100-percent" 

RNAV  condition.  i 


TEST  BED. 


general.  RNAV  and  Jet-VQR  traffic  density  reduced  from  Lincoln  Laboratory 
tapes  were  Inputs  to  the  DSF  computer's  programs  for  both  fast-time  and  real- 
time tests.  The  DSF  target  generator  caused  these  aircraft  to  fly  In  accord- 
ance with  the  stored  flight  plan  data  and  aircraft  performance  characteristics. 
In  the  real-time  teats,  the  air  traffic  controller  could  modify  the  aircraft's 
flight  through  a communication  link  between  the  DSF  pilots  eind  the  controllers . 
Keyboard  entries  by  the  DSF  pilots  provided  the  response  to  the  control  Instruc- 
tions In  the  real-time  simulation  testa.  In  the  fast-time  simulations,  no 
controller  Intervention  (Instructions)  was  used. 

DIGITAL  SIMULATION  FACILITY.  The  components  of  the  DSF  used  were:  (1)  the 
Slgma-5  computer,  (2)  DSF  pilots'  displays  and  keyboards  with  associated  mini- 
computer, Alpha- 16,  and  (3)  controllers'  digital  displays,  keypack,  and 
communications.  The  Slgma-5  used  the  following  computer  programs: 

Llnk-1:  geographical  area  with  routes,  fixes,  radar  map,  operational 

radar,  and  aircraft  profiles  by  category. 

Llnk-2:  display  aircraft  position  with  data  block  on  digital  display 

at  associated  tube  by  control  position,  record  number  and 
type  of  controller  and  pilot  keyboard  Inputs  to  be  acted  on 
and  number  and  length  of  each  radio  or  Interphone  contact  by 
control  position,  aircraft  position  (x,y),  and  statixs,  as  IN 
or  OUT  of  problem,  climb  or  descent,  speed,  etc. 

Llnk-3:  data  reduction  of  recorded  Information  required  for  analysis. 

The  Slgma-5  computer  was  used  for  both  fast-  and  real-time  simulation  tests. 

With  the  exception  of  pilot  and  controller  keyboard  messages  and  communication, 
duplicate  data  were  recorded  In  both  time  modes.  Llnk-3  programs  were  usually 
run  on  the  Slgma-8  computer  (see  figure  6). 

PILOTS  AND  DISPLAYS.  Twenty  pilot  positions  (figure  7)  were  required  for  the 
real-time  tests  for  the  five-sector  simulation,  and  nine  for  the  one-sector 
simulation  tests.  All  aircraft  operating  within  the  test  area  were  under 
ATC  control  In  the  real  time  tests.  Fast-time  tests  did  not  require  DSF 
pilots  or  controllers. 

The  pilot  display  contained  the  aircraft's  Identification,  current  altitude, 
and  Indicated  airspeed  and  heading.  Additional  Information,  l.e.,  type  of 
RNAV  equipment,  such  as  high  or  low  category  and  distance  to  descent  point, 
was  added  to  the  display.  The  pilot  could,  through  the  keyboard,  display 
assigned  altitude  when  climbing  or  descending.  This  was  done  so  that  departure 
flights,  when  transferred  to  the  sector  of  Interest,  would  report:  "Leaving 
flight  level  180  for  flight  level  350,"  which  aided  the  controller's  radar 
Identification. 
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AIR  TRAFFIC  CONTROL  POSITIONS.  The  DSF  control  laboratory  Cfigure  8)  was 
configured  to  simulate  five  hlgh-altltude  control  sectors  In  the  Initial  tests 
and  one  sector  In  the  final  teats  of  a National  Airspace  System  O^S)  enroute 
center.  The  test  area  was  supported  by  snipport  sectors  and  a terminal  area 
support  position.  These  support  areas  were  manned  by  air  traffic  controllers 
whose  duties  were  to  give  and  receive  handoffs  to  and  from  the  teat  sectors 
and  insure  that  aircraft  entering  the  teat  area  were  separated  prior  to  the 
handoff . 

Associated  with  each  coordinator,  radar,  and  support  controller  position  was  a 
slew  ball,  keypack.,  radio  transmitter  and  receiver  lines  with  speaker  and 
headset  selection,  and  Interphone  lines  to  the  other  control  positions.  The 
manual  controller  position  equipment  consisted  of  Interphone  lines  and  flight 
progress  strips. 

RADAR  DISPLAYS  AND  DATA  BLOCKS.  The  five-sector  tests  required  eight  simulated 
digital  radar  displays,  and  the  one-sector  tests  required  four  simulated  digital 
radar  displays  to  accommodate  the  test  sector (s)  and  support  areas. 

Associated  with  each  aircraft's  radar  target  was  a data  block.  The  data  block 
contained  the  aircraft's  Identification,  with  the  letter  "R"  added  to  the  end 
of  the  Identification  to  designate  RNAV-equlpped  aircraft.  The  second  line 
of  the  data  block  contained  the  assigned  ^tltude  of  the  aircraft  and  the 
current  altitude  of  the  aircraft.  Between  the  assigned  and  current  altitude, 
an  up  or  down  arrow  was  displayed  to  Indicate  when  the  aircraft  was  climbing 

or  descending,  or  a plus  or  minus  sign  to  Indicate  the  aircraft  was  above  or 

below  assigned  altitude. 

FLIGHT  PROGRESS  STRIPS.  A flight  progress  strip  was  posted  In  each  test 

sector  for  each  aircraft  flight.  Support  sectors  and  terminal  area  were 

provided  with  scripts  listed  on  program  sheets.  The  strips  and  scripts 
Information  contained  aircraft's  Identification,  type  of  aircraft  and  ground- 
speed,  assigned  or  requested  altitude,  and  point  of  departure  and  arrival 
with  associated  route  Information. 

In  the  five-sector  tests,  the  controllers  were  also  provided  with  an  alphabet- 
ized script,  because  the  strips  were  not  readily  available  from  the  adjacent 
bays.  In  the  one-sector  tests,  the  manual  controller  kept  current  strips 
In  front  of  the  radar  controller. 

FIX  AND  ROUTE  NOMENCLATURE.  Fixes  were  Identified  by  the  five  test  sectors 
Identification.  The  teat  sectors  were  designated  clockwise  from  the  southern 
sector  (13),  A,  B,  C,  D,  and  E.  Fixes  within  the  test  sectors  were  designated 
by  the  sector's  letter  and  number  and  fixes  In  the  support  area  were  assigned 
two-letter  Identification,  with  the  first  letter  being  that  of  the  adjacent 
test  sector.  The  exceptions  were  navigation  aides  (VOR's)  and  airports,  which 
were  assigned  their  published  Identification. 

Routes  were  Identified  by  consecutive  fixes  with  no  route  designation. 
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The  above  methods  of  fix  and  route  identification  were  used  to  facilitate  the 
area  checkout  of  each  controller.  Depicted  on  the  radar  map  were  intersections 
of  routes  and  start  points  td.th  their  Identification.  Approach  fix  Identifica- 
tion and  route  centerlines  were  not  depicted  on  the  radar  map  to  reduce  clutter. 

CONTROLLERS*  LABORATORY  CONFIGURATION.  Shown  in  figure  9 are  the  laboratory 
configuration  and  controller's  operating  positions.  Two  control  positions 
were  associated  with  each  radar  display  and  identified  by  display  number. 

Lach  control  position  had  a keypack  to  control  data  block  information,  receive 
and  make  handoffs,  and  point  out  aircraft  to  other  control  positions. 

TEST  DESICTi. 

GROUND  RULES.  The  following  ground  rules  governed  the  conduct  of  the  tests: 

(1)  Only  aircraft  operating  under  instrument  flight  rules  (IFR)  were 
simulated. 

(2)  Radar  separation  minima  were  in  accordance  with  Stage  A digitized 
(narrowband)  radar  systems. 

(3)  Traffic  entering  or  leaving  the  controller's  area  of  jurisdiction  was 
separated  by  the  transferring  controller  prior  to  handoff. 

(4)  Aircraft  on  vectors  or  RNAV  offset  were  coordinated  with  the 
receiving  controller. 

4 

(5)  All  aircraft  simulated  had  operating  4096  beacon  transponder  equipment 
with  automatic  altitude  reporting. 

(6)  Adequate  radar,  communication,  and  navigation  aids  coverage  existed 
at  all  times  in  the  area  simulated. 

(7)  The  traffic  density  reduced  from  the  Lincoln  Laboratory's  data  tapes  ^ 

supported  the  simulation  test  objectives. 

(8)  Data  reduction  programs  determined  when  the  aircraft  was  in  the  test 
sector  and  only  these  data  were  used  for  fast-  and  real-time  analysis. 

GEOGRAPHY . The  areas  simulated  covered  an  area  of  approximately  500  by 
300  nml  for  the  five-sector  tests  and  255  by  120  nml  for  the  one-sector  tests. 

Figures  2 through  5 show  the  simulated  area  with  associated  routes  used  for 
both  simulation  of  the  Jet-VOR  and  RNAV  systems.  As  previously  mentioned, 
some  of  the  VOR  routes  were  retained  for  simulation  of  the  RNAV  environment 
to  Insure  that  routes  were  available  for  all  traffic  simulated,  since  the 
RNAV  route  structure  design  simulated  provided  routes  serving  only  major 
traffic  flows,  representing  the  major  portion  of  the  total  traffic.  The 
Jet-VOR  route  structure  shown  in  figures  2 and  4 includes  charted  Jet-VOR 
routes,  transition,  and  direct  fllghtpaths.  The  RNAV  structure  shown  in  : 

figures  3 and  5 depicts  the  RNAV  structure  simulated,  Including  transition  | 

routes  that  would  normally  not  be  depicted  on  an  airway  chart.  Therefore,  | j 
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the  reader  Is  cautioned  that  these  Illustrations  of  both  the  Jet-VOR  structure 
and  RNAV  structure  represent  fllghtpaths  rather  than  charted  airways.  In  the 
fast-time  simulations,  flights  flew  via  the  fllghtpaths  Illustrated.  In  the 
real-time  simulations,  flights  were  Initially  cleared  via  the  paths  depicted, 
but  as  the  result  of  controller  Intervention,  the  fllghtpaths  could  be 
modified  by  radar  vectors,  parallel  offsets,  or  other  forms  of  rerouting. 

A terminal  support  area  controlled  flights  departing  the  Chicago  terminal  area. 
Departures  were  released  to  the  hlgh-altltude  sectors  approximately  45  nml 
from  the  center  of  the  terminal  area,  usually  below  16,000  feet.  Arrival 
flights  were  released  to  the  terminal  controller  at  the  appropriate  approach 
fix  at  17,000  feet  or  above.  Boundaries  for  the  support  sectors  were  the 
adjacent  test  sector  boundary. 

TRAFFIC  SAMPLES.  A master  traffic  sample  was  developed  duplicating  to  the 
highest  degree  possible  that  portion  of  the  Lincoln  Laboratory  traffic  sample 
(per  the  year  1977)  that  Impacted  on  the  areas  to  be  simulated  In  real-time. 

By  randomizing  the  start  times  for  aircraft  entering  the  simulated  sectors, 

20  additional  traffic  samples  were  developed.  All  21  RNAV  samples  were 
simulated  In  fast-time  and  an  Initial  selection  was  made  based  on  the  data. 

Only  those  Jet-VOR  samples  corresponding  to  the  best  RNAV  runs  were  made.  The 
selection  of  samples  was  based  on  obtaining  a wide  and  uniform  spread  In  the 
numbers  of  potential  conflicts  for  each  sector  for  both  the  RNAV  and  Jet-VOR 
samples.  The  number  of  potential  conflicts  (instances  in  which  less  than 
minimum  standard  separation  existed)  within  each  sector  was  recorded  as  shown 
In  table  1. 

Potential  conflicts  are  violations  of  standard  ATC  separation  criteria  which 
occur  during  uncontrolled  (fast-time)  simulation  tests.  These  conflicts  are 
considered  "potential  conflicts"  In  the  sense  that  In  a controlled  situation, 
action  could  be  taken  to  prevent  the  violation.  Standard  radar  separation 
criteria  were  used  In  accordance  with  the  Air  Traffic  Control  handbook  8110.65, 
dated  January  1,  1976  (reference  2).  Basically  tuls  criteria  requires  that 
flights  below  60,000  feet  (FL  600)  and  40  nml  or  more  from  the  radar  antenna 
be  separated  by  a minimum  of  5 nml  unless  vertical  separation  Is  provided 
(l.e.,  1,000  feet  at  and  below  29,000  feet  (FL  290),  and  2,000  feet  above 
29,000  feet). 

A flight  level  Is  an  altitude  level  of  constant  atmospheric  pressure  related 
to  a reference  datum  of  29.92  Inches  of  mercury.  Each  Is  stated  In  three 
digits  representing  hundreds  of  feet.  For  example,  FL  250  represents  a 
barometric  altimeter  Indication  of  25,000  feet  (FAR  Part  1).  For  the  pur- 
pose of  these  testa,  potential  conflicts  were  recorded  at  and  above  17,000 
feet,  the  hlgh-altltude  stratum  starts  at  FL  180. 

Eight  traffic  samples  were  selected  for  real-time  simulation  of  the  five- 
sector  configuration,  and  subsequently  three  of  these  samples  were  used  In 
the  one-sector  configuration  tests  as  shown  In  table  2.  Table  2 also  shows 
the  density  of  aircraft  within  the  2-hour  simulated  period  varies  between 
samples,  due  to  the  effect  of  randomized  start  times,  and  between  the  RNAV 
and  VOR  systems  as  the  result  of  the  difference  of  the  routes  and  sectors 
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TABLE  2.  AIRCRAFT  DENSITY  BY  SECTOR 


2-hour  Data  Period 
Five-Sector  Tests 


Samples 


1 Sector 

Systems 

2 

6 

2 

9. 

10_ 

15 

17 

19 

I 9 

RNAV 

46 

43 

46 

56 

57 

58 

58 

54 

VOR 

45 

58 

49 

46 

47 

47 

48 

45 

28 

RNAV 

69 

69 

68 

76 

79 

78 

79 

80 

VOR 

93 

92 

70 

92 

92 

93 

93 

88 

29 

RNAV 

72 

72 

72 

80 

85 

85 

81 

82 

VOR 

69 

67 

70 

67 

64 

68 

65 

69 

14 

RNAV 

50 

50 

52 

61 

57 

62 

61 

60 

VOR 

68 

69 

70 

69 

69 

70 

71 

69 

13 

RNAV 

97 

98 

99 

101 

102 

104 

101 

101 

VOR 

93 

93 

93 

91 

94 

93 

90 

94 

One-Sector 

Tests 

_1 

_6 

10 

28 

RNAV 

63 

63 

63 

• 

VOR 

69 

70 

69 

TABLE  3.  POTENTIAL  CONFLICTS— SECTOR  28, 
ONE-SECTOR  TESTS 


System 

RNAV 

Jet-VOR 


Sample  Number 

1 i 

4 8 

10  27 


12. 

3 

18 
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penetrated  by  these  routes.  It  should  also  be  noted  that  in  the  one-aector 
configuration  (using  sector  28  only),  the  alrcr£ift  density  within  sector  28  in 
the  one-sector  tests  is  less  in  all  three  traffic  samples  than  is  shown  for  the 
same  sector  and  traffic  samples  In  the  five-sector  configuration.  This  was  the 
result  of  the  deletion  of  those  flights  simulated  in  the  five-sector  tests  that 
only  cut  across  a comer  of  sector  28  and  had  minimum  Impact  on  controller  work- 
load and  did  not  affect  the  conflict  count  shown  in  table  1 and  table  3.  (See 
appendix  B and  table  B-1,  for  traffic  sample  coiq>osltlon  and  matrices.) 

Shotm  in  table  4 is  the  total  number  of  aircraft  that  entered  the  test's  area 
during  the  2-hour  data  collection  period  for  the  fast-time  simulation  of  the 
five-  and  one-sector  configurations. 


TABLE  4.  AIBCRAFT  DENSITY-FAST-TIME 
2-Hour  Data  Period  by  System  and  Sample 


Five  Sectors  Tests  Samples 


Systems 

2 

6 

2 

9 

10 

15 

17 

li 

RNAV 

280 

275 

277 

275 

273 

279 

274 

281 

Jet-VOR 

277 

275 

279 

274 

273 

277 

275 

276 

One 

Sector 

Tests  Samples 

1 

6 

RNAV 

63 

63 

63 

Jet-VOR 

69 

70 

69 

CONTRDT.T.F.R  PROCEDURES.  Standard  ATC  procedures  were  applied  as  stated  in 
handbook  7110.65  (reference  2),  and  RNAV  procedures  and  phraseology  were  used 
as  applicable.  Controllers  were  Instructed  to  provide  ATC  and  related  services 
to  all  aircraft  under  their  jurisdiction. 


Departures  from  the  same  airport  were  separated  by  a minimum  of  32  seconds  ] 

as  provided  by  the  basic  data.  Departure  control  separated  aircraft  prior  < 

to  reaching  17,000  feet.  No  separation  was  given  below  17,000  feet  to  Insure  i 

as  much  duplication  of  the  fast-time  runs  as  possible. 

Iji 

Support  sectors  provided  separation  only  at  the  sector  boundary  for  aircraft 

entering  the  sector  of  Interest.  As  long  as  the  aircraft  were  separated  at  the 

boundary,  no  action  was  taken  by  the  support  sector  unless  requested  by  the 

test  sector  controller.  This  was  to  Insure  that  potential  conflicts  identified 

from  fast-time  runs  would  be  duplicated  to  the  extent  possible  in  the  real-time  I 

runs  of  the  sector (s)  of  Interest. 


Further  restrictions  to  the  sector-of-lnterest  controller  was  the  limitation 
of  arrival  aircraft  remaining  at  altitude  until  a request  for  descent  was 
received  from  the  aircraft.  This  was  done  to  duplicate  the  fast-time  runs,  and 
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to  determine  the  Impact  of  controller's  Intervention  on  altitude  assignment 
and  restrictions.  This  procedure  was  introduced  only  In  the  one-sector 
configuration.  DSF  pilots  were  Instructed  to  refuse  descent  clearance  from 
cruise  altitude  until  within  30  nml  of  descent  point  or  request  clearance 
when  within  10  nml  of  descent  point. 

The  descent  point  was  a point  at  which  arrival  aircraft  would  start  a descent 
to  cross  the  arrival  fix  at  17,000  feet.  The  descent  point  was  determined 
by  the  aircraft's  descent  rate  and  groundspeed.  The  point  would  differ  by 
aircraft  category  and  flight  plan  true  airspeed. 

Another  restriction  to  the  sector-of-lnterest  controller  was  the  use  of  speed 
restriction  which  pilots  refused  If  their  aircraft  was  at  or  above  FL  290. 

All  aircraft  cleared  off  of  filed  flight  plan  route  were  coordinated  with 
the  support  or  sector-of-lnterest  controller  prior  to  transfer  of  control. 

PILOT  PROCEDURES.  Prior  to  the  laboratory  tests,  the  DSF  pilots  received  a 
detailed  briefing  on  the  purpose  and  objectives  of  the  simulation.  They  were 
given  material  which  defined  their  expected  Inputs  and  responses  to  control 
Instruction.  The  tests  for  five  sectors  required  20  pilots,  and  9 pilots  were 
required  for  the  one-sector  tests. 

TRAINING.  Controller  and  pilot  training  started  March  29,  1976,  and  continued 
to  April  20,  1976.  During  this  time,  controllers  were  checked  out  on  two 
control  positions  using  the  master  sample  for  traffic  Input  for  both  the  Jet- 
VOR. and  RNAV  systems.  A refresher  training  period  was  given  for  one-sector 
tests. 

TEST  MATRIX.  The  simulation  was  planned  to  provide  statistical  results  from 
both  fast-  and  real-time  simulation  of  both  systems:  Jet-VOR  and  hlgh-altltude 
RNAV  routes. 

The  test  was  divided  into  four  parts  for  both  the  five-  and  one-sector 
configurations : 

Part  1 Jet-VOR  aircraft  without  controller  Intervention, 

Part  2 RNAV  aircraft  without  controller  Intervention, 

Part  3 Jet-VOR  aircraft  with  controller  Intervention,  and 

Part  4 RNAV  aircraft  with  controller  Intervention. 

It  was  anticipated  that  more  potential  conflicts  would  result  In  part  1 than 
In  part  2,  based  upon  previous  Lincoln  Laboratory  fast-time  simulation  results. 


The  four  parts  provided  a basis  for  the  following  statistical  comparisons: 


2.  The  number  of  potential  confUcta  versus  controller  %rorkload, 

3.  A basis  to  determine  the  effect  on  controller's  workload  and  user 
Impact  as  a function  of  controller  intervention  under  conditions  In  which 
known  numbers  of  potential  conflicts  were  given. 

4.  Compare  controller  workload  and  system  user  impact  between  RNAV 
and  Jet-VOR  systems. 

Shown  in  table  5 is  the  test  design  for  the  number  of  data  runs  for  the  five- 
sector  tests. 


TABLE  5.  TEST  DESIGN-FIVE  SECTORS » NUMBER  OF  DATA  RUNS 


JET-VOR 

Sample  Fast-Time.  Real-Time 


RNAV 

Faat-T^mp  Real-T^^n<» 


2 1 

6 1 

7 1 

9 1 

10  1 

15  1 

17  1 

19  1 


2 

2 

2 

2 

2 

2 

2 

2 


1 

1 

1 

1 

1 

1 

1 

1 


2 

2 

2 

2 

2 

2 

2 

2 


Total  8 


16 


8 


16 


Two  controller  teams  were  used  In  tlie  five-sector  configuration  tests.  Test 
controllers  were  assigned  a sector  under  each  team  configuration.  The  order 
of  runs  by  sample  was  RNAV,  VOR,  VOR,  RNAV,  RNAV,  etc. , for  team  A.  For  team 
B It  was  VOR  RNAV,  RNAV,  VOR,  VOR,  etc.  Team  B was  formed  by  randomly  reassign- 
ing the  controllers  from  team  A to  the  various  support  and  test  sectors 
for  their  test  runs.  This  type  of  assignment  Is  comparable  to  ARTCC  assignment 
practices . 


Shown  In  table  6 Is  the  test  design  for  the  number  of  data  runs  for  the 
one-sector  tests . 


TABLE  6.  TEST  DESIGN— ONE  SECTOR,  NUMBER  OF  DATA  RUNS 


Jet-VOR 

Real-Time 


4 

4 

4 

12 


RNAV 

Real-Time 


4 

4 

4 

12 


Sample  Fast-Time 

1 1 

6 1 

10  1 


Total  3 


Fast-Time 

1 

1 

1 

3 
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The  one-sector  design  was  four  teams,  three  samples,  and  two  systems.  The 

run  order  by  sample  and  system  was  duplicated  for  teams  1-2,  and  3-4.  j 

Each  team  made  one  run  per  sample  under  each  system,  and  each  team  completed  1 

all  six  nins  prior  to  the  next  team  tests.  Teams  1 and  2 runs  were  Jet-  I 

VOR,  followed  by  RNAV  runs.  Team  3 and  4 runs  were  RNAV,  followed  by  Jet-  j 

VOR  runs.  The  24th  data  run  was  completed  July  28,  1976.  | 

DATA  RUNS.  REAL-TIME.  | 

The  purpose  of  the  real-time  runs  was  to  correlate  the  resultant  data  with  the  ] 

base  fast-time  data.  The  problem  with  duplicating  fast-time  conflicts  was  ] 

controller  reaction  to  these  situations.  Conflict  conditions  were  eliminated  j 

by  the  controller  giving  offset  or  vectors  to  aircraft  prior  to  the  situation  ■ 

developing.  The  vector  or  offset  would  create  a new  route  for  the  aircraft  i 

which  bypassed  the  fast-time  routing.  Thus,  duplication  of  potential  conflicts 
in  the  real-time  simulation  was  not  possible.  In  many  cases,  a controller-  j 

assigned  vector  or  offset  or  altitude  restriction  might  resolve  several  poten-  j 

tlal  conflicts  on  the  one  hand,  but  could  also  result  In  some  other  potential  i 

conflicts  developing  later  that  were  not  present  in  the  fast-time  simulation. 

This  effect  could  not  be  Isolated  or  analyzed  in  this  simulation.  ] 

i 

Data  block  clutter  was  a problem  to  the  controllers.  This  was  the  result  of 
data  block  size  and  the  sector  area  displayed.  As  a result,  controllers  would 
clear  an  aircraft  for  a 5-nml  offset  and  the  next  aircraft  for  a 10-nmi  offset 
to  Insure  that  data  block  overwrite  would  not  occur.  This  action  by  the 
controller  reduced  the  number  of  data  block  positioning  messages  and  his 
workload.  The  same  held  true  for  vector  clearances,  in  that  aircraft  on 

common  routes  were  given  vectors  which  paralled  the  filed  route  by  5 and  t 

10  nmi,  respectively. 

The  controllers  were  unreceptlve  to  having  aircraft  remain  on  their  filed 

route  with  potential  conflict  situations  recurring.  Instead,  the  controllers 

Issued  clearance  which  Insiured  separation  and  reduced  the  number  of  control 

Instructions  for  all  potential  conflict  situations  well  prior  to  the  condition 

occurring.  This  resulted  in  route  modifications  and  altitude  restrictions  - i 

being  Imposed  on  flights  chat  may  not  have  been  involved  in  a potential  conflict 

if  left  to  fly  along  the  initially  cleared  route  and  no  altitude  restriction 

Imposed.  Departure  and  arrival  aircraft  were  not  cleared  back  to  their  filed  { 

route  until  requested  or  approach  fix  altitude  was  reached.  If  the  requested  j 

or  approach  fix  altitude  was  not  available,  the  next  available  altitude  was 

assigned,  rather  than  have  the  aircraft  remain  on  an  offset  or  vector. 

DATA  COLLECTION.  From  the  3-hour  simulation  run,  a 2-hour  data  period  was  j 

recorded  on  magnetic  tapes.  The  recording  period  was  controlled  by  the  computer 
program.  The  first  hour  of  the  simulation  was  used  to  load  aircraft  into 

the  test  area.  The  second  hour  was  the  start  of  the  data  collection  period.  j 

I 

The  data  were  analyzed  by  computer  programs  to  determine  when  each  aircraft  was 

in  Che  test  sector  and  to  provide  measures  of  systems  performance  and  controller  ! 

workload.  No  analyses  were  made  for  aircraft  outside  of  the  test  sector(s) . | 

I 
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Shown  in  appendix  C are  the  data  that  were  recorded  on  magnetic  tapea  during 
the  data  collection  period.  From  these  data,  the  aystem  measures  were  reduced. 

MEASURES . The  measurements  reduced  from  fast-  and  real-time  simulation  data 
and  analyses  are  defined  as  follows: 

1.  Potential  Conflicts  are  the  number  of  violations  of  conflict  criteria. 
The  number  represents  the  numher  of  occurrences  and  not  the  number  of  aircraft 
involved . 

2.  Time  In  System  Is  the  time  In  seconds  that  each  aircraft  was  in 
the  test  area. 

3.  Distance  Flown  is  the  mileage  In  nautical  miles  that  the  aircraft 
flew  In  the  test  area. 

4.  Number  of  Aircraft  Handled  Is  a count  of  the  number  of  aircraft 
that  entered  the  test  area. 

5.  Nvmber  of  Push-to-Talk  Is  a count  of  the  nunher  of  controUer-to— 
pilot  radio  transmissions  made  by  the  test  controller(a) . 

6.  Total  Talk  Time  la  the  sum  of  all  radio  transmissions.  In  seconds, 
made  by  the  test  controller(s) . 

7.  Average  Contact  Duration  is  the  total  talk  time  divided  by  the 
total  of  push-to-talk  messages.  The  results  are  average  radio  contact  dura- 
tion per  message  in  seconds. 

8.  Average  Number  of  Contacts  per  Aircraft  is  the  sum  of  the  number  of 
push-to-talks  divided  by  the  number  of  aircraft  handled.  The  result  Is  the 
average  number  of  communications  per  aircraft  controlled. 

9.  Average  Talk  T^^BP  p^r  Aircraft  la  the  total  talk  time  divided  by  the 
number  of  aircraft  hauidled.  The  results  are  average  duration  (seconds)  of  com- 
munications per  aircraft  controlled. 

10.  Number  of  Control  Messages  Is  the  count  of  control  messages  to  the 
pilot  which  would  require  a change  In  flight  such  as  climb,  speed,  vector, 
offset,  etc. 

Listed  In  table  7 Is  the  application  of  the  measures  under  fast-time 
simulation  and  real-time  simulation  tests. 

It  was  anticipated  (for  the  purpose  of  correlation  of  fast-  and  real-time 
simulation  results)  that  as  the  potential  conflicts  increased/decreased,  there 
would  be  a correlation  with  controller  workload  and/or  system  Impact. 
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TABLE  7.  BATA  MEASURES 
Tests 

Fast-Time  Simulation  Real-Time  Simulation 


Time  in  System 
Distance  Flown 
Number  of  Aircraft  Handled 
Number  of  Push-to-Talk 
Total  Talk  Time 
Average  Contact  Duration 
Average  Number  of  Contacts 
per  Aircraft 

Number  of  Control  Messages 
Average  Talk  Time  per  Aircraft 


RESULTS 


To  determine  whether  differences  existed  between  the  test  variables,  the  results 
of  fast-  and  real-time  simulation  tests  were  subjected  to  statistical  tests. 

The  significance  level  was  prees tabllshed  at  a=.05  for  applicable  tests.  This 
95-percent  confidence  level  determined  the  acceptance  or  rejection  of  the  null 
hypothesis  that  there  Is  no  difference  between  the  tested  measures. 

FAST-TIME  SIMULATION  RESULTS. 

COMPARISON  OF  LINCOLN  LABORAI(»Y  DATA  WITH  FAST-TIME  SIMULATION  DATA.  Fast- 
time  simulations  were  made  using  21  RNAV  and  10  Jet-VOR  samples  In  order  to 
select  a combination  of  8 samples  for  real-time  simulation  which  exhibited  good 
statistical  properties  for  the  regression  analyses  to  be  conducted  after  the 
real-time  runs. 

The  number  of  potential  conflicts  and  average  Instantaneous  traffic  load 
(aircraft  density  per  run)  for  each  of  the  21  fast-time  runs  was  collected, 
and  summary  statistics  were  calculated  as  shown  In  tables  8 and  9,  respectively. 
These  data  were  subjected  to  a series  of  statistical  tests  employing  the 
Students'  t distribution  which  assumes  a normally  distributed  parent  population. 
A plot  of  the  data  for  tables  8 and  9 showed  that  the  plotted  data  do  not 
produce  a bell-shaped  curve  which  a normal  distribution  would  present.  Since 
the  statistical  assumption  of  normality  was  not  well  satisfied,  tests  of 
the  hypothesis  using  a t distribution  were  used  which  were  Insensitive  to 
violations  of  the  normality  assumption;  see  reference  3,  p.  305. 

These  data  were  compared  with  the  2-hour  estimated  potential  conflict  data 
from  the  Lincoln  Laboratory  simulations.  The  results  of  this  comparison  are 
given  In  table  10.  As  can  be  seen  In  that  table,  the  results  for  the  aggregate 
of  the  five  sectors  are  In  good  agreement.  However,  for  sector  13  for  the 
Jet-VOR  route  structure,  there  are  substantial  differences  between  the  Lincoln 


Potential  Conflicts 

Time  In  System 

Distance  Flown 

Number  of  Aircraft  Handled 
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TABLE  10.  COMPARISON  OF  DSF  AND  LINCOLN  LABORATORY  (LL) 

POTENTIAL  CONFLICT  COUNTS  IN  FAST-TIME  SIMULATION 
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Laboratory  estimates  and  the  DSF  fast-time  results.  These  data  were  compared  I 

statistically  to  determine  if  the  Lincoln  Laboratory  estimate  could  be  conald-  I 

ered  a random  sample  from  the  distribution  of  DSF  results.  This  test  was 
derived  (see  appendix  D)  from  a procedure  described  in  reference  4 (y  statistic  ! 

page  489)  for  determining  if  two  samples  are  from  the  same  distribution.  j 

The  results  Indicate  that  the  Lincoln  Laboratory  estimates  for  Jet-VOR  sector  | 

13  were  significantly  different  than  the  DSF  results  at  the  5-percent  level. 

Since  the  Lincoln  Laboratory  estimates  were  prepared  by  reducing  the  known 
5-hour  potential  conflict  count  by  a scaling  factor  estimated  from  the  nation- 
wide data,  it  is  quite  possible  that  these  estimates  are  in  error  due  to  local 
(l.e.,  sector-by-sector)  variations  in  that  ratio.  The  close  comparison 
of  the  aggregate  data  substantiates  this  conjecture,  since  that  ratio  would 
be  more  stable  for  larger  subgroupings  of  the  sectors. 

RNAV  VERSUS  JET-VOR.  A second  series  of  tests  was  conducted  to  determine 

(1)  if  the  number  of  potential  conflicts  which  occurred  using  the  Jet-VOR 

route  structure  was  significantly  greater  than  the  number  of  potential 

conflicts  \dilch  occurred  using  the  RNAV  structure,  and  (2)  if  the  average 

aircraft  load  (aircraft  density)  was  different  when  using  the  RNAV  and  Jet- 

VOR  structures.  The  results  of  these  tests  are  shown  in  tables  11  and  12,  « 

respectively.  Since  there  are  large  differences  in  some  of  the  sample 

variances,  particularly  for  the  potential  conflict  count,  a procedure  for  |j 

handling  two-sample  tests  with  unequal  variance  developed  by  Walsh  (1937) 

and  documented  in  reference  5 (p.  299)  was  employed  to  determine  statistical  1 

significance.  As  can  be  seen  in  table  11,  the  total  conflict  count  across  ] 

all  sectors  for  the  Jet-VOR  runs  was  significantly  greater  than  the  count  | 

for  the  RNAV  runs.  This  difference  was  created  by  very  significant  improve-  ; 

ments  for  RNAV  in  sectors  28  and  14  and  a marginal  improvement  in  sector  29.  '] 

(The  mild  adv£intage  of  the  Jet-VOR  structure  in  sector  9,  was  not  statistically 
significant.)  j 

In  spite  of  great  care  in  duplicating  the  flights  and  routes  through  both 

samples,  the  average  aircraft  load  in  the  RNAV  samples  was  significantly  ] 

greater  than  in  the  VOR  samples  for  the  five-sector  configuration.  This  I 

difference,  although  not  large  (0.3  aircraft),  is  significant,  due  to  the  'i 

very  small  run- to-run  variances  (0.12  eilr craft),  and  is  probably  caused  by 

the  fact  that  when  viewed  from  the  national  level,  certain  flights  may  totally  ; 

avoid  the  five  key  sectors.  This  effect  is  compounded  by  differences  between  : 

the  relative  entry  times  of  the  alrcreift  into  the  five  sectors  in  the  Jet-VOR 

structure  versus  those  entering  the  five  sectors  in  the  RNAV  structure.  These 

entry  times  were  determined  based  on  conmon  airport  departure  times  for  both 

structures  and  subsequent  transit  time  over  the  respective  national  structure 

used  in  the  Lincoln  Laboratory  simulations.  The  different  transit  times 

cause  different  aircraft  to  be  within  the  five  key  sectors  during  the  2-hour 

period  selected.  These  effects  are  even  more  apparent  on  a sector-by-sector 

basis,  where  larger  and  more  significant  differences  were  ooserved.  ! 

The  presence  of  significant  differences  in  the  average  aircraft  load  data  could 
complicate  the  analysis  of  the  real-time  restilts,  particularly  if  the  number 
of  potential  conflicts  was  dependent  upon  the  load.  To  check  for  this  depend- 
ence, several  tests  were  performed.  First,  the  correlation  coefficient 
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TABLE  11.  CX)MP ARISON  OF  RNAV  AND  JET-VOR  ROUTE  STRUCTURES,  POTENTIAL  CfflJFLICT  COUNT 

IN  FAST-TIME  SIMULATION 
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(reference  5,  p.  217)  vas  computed  for  each  sector  and  for  the  total  area  for 
both  structures.  These  values  were  tested  for  being  significantly  different 
than  zero  using  the  procedure  described  in  reference  5,  page  358.  As  shown 
in  table  13,  in  no  case  was  the  correlation  coefficient  significant,  indica- 
ting that  within  each  sector,  the  variations  in  average  load  did  not  cause  a 
related  variation  in  potential  conflicts.  This  lack  of  correlation,  however, 
was  probably  caused  by  the  small  range  of  variation  in  the  average  traffic 
load.  Therefore,  the  sector  average  values  of  the  traffic  load  and  potential 
conflict  count  were  compared  using  Spearmans'  Rank  Correlation  (reference  5, 
p.  424).  This  procedure  yielded  a correlation  of  0.736  %fhich  is  significant 
at  the  0.98  level.  Taken  together,  these  two  facts  indicate  that  there  is  a 
relationship  between  traffic  load  and  potential  conflict  count. 

REAL-TIME  SIMULATION  RESULTS. 

After  completion  of  20  data  runs  of  the  five-sector  configuration,  it  was 
determined  that  the  uncontrolled  variables  Introduced  in  the  simulation  by 
controller  intervention  precluded  collection  of  data  for  determination  of  any 
possible  correlation  between  potential  conflicts  and  controller  workload  and 
system  user  measures.  It  was  determined,  therefore,  to  discontinue  the  five- 
sector  configuration  prior  to  completion  of  the  planned  32  tests  and  to  start 
tests  of  the  one-sector  configuration.  The  24  runs  planned  for  the  one-sector 
configuration  were  completed.  However,  even  though  the  one-sector  tests  were 
closely  monitored,  the  same  problems  generally  existed  in  attempting  to  find 
any  correlation  between  potential  conflicts  found  in  the  fast-time  simulation 
and  the  real-time  simulation  results. 

Analysis  of  this  experiment  focused  on  the  four  fast-time  measures  and  the 
nine  real-time  measures  listed  in  table  7.  The  data  measurements  for  the 
five-sector  configuration  are  presented  in  table  14.  For  the  single-sector 
configuration,  the  fast- time  measurements  are  presented  in  table  15,  and 
the  real-time  results  are  Included  as  table  16.  Because  of  a program  error, 
it  was  not  possible  to  obtain  the  fast- time  measurements  for  the  five-sector 
configuration  as  presented  for  the  one-sector. 

The  expected  results  of  the  experiment  were  the  following: 

1.  Comparison  of  user /system  benefits /impact  of  the  two  ATC  systems. 

2.  Correlation  of  fast-time  and  real-time  simulation  results. 

3.  Relationship  of  controller  workload  and  system  user  Impact  to  pre- 
determined quantities  of  potential  aircraft  conflict  situations. 

The  ATC  system  benefit  comparisons  were  made  on  the  data  from  the  first  20  data 
runs  (l.e.,  five  sectors),  and  the  correlation  and  potential  conflict  analyses 
were  based  on  the  single-sector  data.  The  inclusion  of  five-sector  tests  was 
due  to  the  fact  that  the  RMAV  and  Jet-VOR  route  structures  were  balanced  in 
the  overall  five-sector  configuration;  however,  the  routes  were  not  balanced 
when  the  test  area  was  reduced  to  a single  sector.  Because  of  the  large  run- 
to-run  variation  in  the  five-sector  tests,  it  was  virtually  impossible  to 
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TABLE  13.  CORRELATION  BETWEEN  AVERAGE  AIRCRAFT  LOAD  AND 
POTENTIAL  CONFLICTS  IN  FAST-TIME  SIMULATION 


Structure 


Sector 

RNAV 

Jet-VOR 

2 

-Q.Q896 

-0.0108 

5 

.2847 

.4605 

7 

- .2205 

.2744 

9 

- .0816 

.4296 

11 

.0815 

.0609 

Total 

- .0455 

.3212 

Critical 

Correlation 

Coef flclent^ 

■ .10 

.3700 

.5490 

^The  significance  ol  the  correlation  coefficient  can  be  tested  using  the 
Students'  t distribution  using  the  following  relationship: 

t„  -2.  1-./2  - p 

where: 

^n-2,  1-  /2  ■ The  tabulated  Students'  t value  for  n-2  degrees  of  freedom 
and  a significance  level  of  a for  n,  two-sided  test  of 
hypothesis 

p - Sample  correlation  coefficient 
n ■ Sample  size 

For  a given  sample  size,  this  relationship  can  he  Inverted  to  provide  a 
critical  correlation  coefficient.  Values  greater  than  this  level  are 
significant: 


TABLE  14.  REAL-TIME  DATA  MEASUREMENTS  FOR  FIVE-SECTOR  CONFIGURATION 
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TABLE 

15.  FAST-TIME 

DATA  MEASUREMENTS 

FROM  ONE-SECTOR 

CONFIGURATION 

Sample 

Potential 

Conflicts 

Time- In 
System 
(Seconds) 

Distance 

Flown 

(nml) 

Aircraft 

Handled 

R1 

4 

46,081 

5,542.5 

63 

R6 

8 

49,695 

5,908.5 

63 

RIO 

3 

49,633 

5,913.2 

63 

VI 

10 

60,297 

7,248.0 

69 

V6 

27 

61,013 

7,336.6 

70 

ViQ 

18 

60,616 

7,319.8 

69 
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TABLE  16.  REAL-TIME  DATA  MEASUREMENTS  FOR  ONE-SECTOR  CONFIGURATION 
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obtain  objective  data  which  would  allow  the  effect  of  potential  conflicts 
on  controller  workload  and  system  user  activity  to  be  Identified  or  measured. 

Therefore,  statistical  analyses  of  potential  conflicts  were  limited  to  the 
one-sector  tests. 

FIRST  EXPECTED  RESULTS.  The  F ratio  of  the  analysis  of  variance  statistical 
tests  was  used  for  messages  of  the  two  ATC  systems.  The  means  of  the 
samples  were  tested  for  differences  between  the  RMAV  and  Jet-VOR  route 
configurations,  and  the  breakdown  of  the  Individual  communication  messages 
Is  presented  In  table  17.  For  all  the  controller-to-pllot  communication 
measures  except  average  radio  contact  duration,  the  RNAV  route  configuration 
was  significantly  superior.  There  was  no  significant  difference  between  the 
system  configurations  for  time  In  system,  distance  flown,  and  flights  handled. 

The  sample  means  are  listed  In  table  18. 

[ The  reduction  In  controller  workload  measures  (communications  contact,  total 

communications  time,  and  number  of  control  Instructions  Issued)  found  for 
RNAV  compared  to  VOR-radar  vector  control  was  similar  to  but  not  as  pronounced 
[ as  that  found  In  previous  terminal  area  simulations  (references  6 and  7). 

! 

SECOND  EXPECTED  RESULTS.  The  second  expected  result  of  the  experiment  was 
^ the  correlation  of  fast-time  and  real-time  simulation  results  for  the  slngle- 

[ sector  configuration.  The  correlation  coefficient  Is  a statistical  measure 

[ of  the  linear  relationship  between  two  variables.  By  definition  the  coeffl- 

I dent  must  be  between  -1  and  +1.  A coefficient  close  to  +1  (-1)  means  a 

positive  (negative)  relationship;  that  Is,  as  one  variable  Increases,  the 
other  also  Increases  (decreases) . 

Because  of  the  lack  of  balance  between  the  RNAV  and  Jet-VOR  single-sector 
route  structures  In  the  one-sector  tests.  It  was  not  statistically  valid 
to  estimate  the  correlations  between  the  RNAV  and  Jet-VOR  data.  The  matrix  of 
correlation  coefficients  for  the  RNAV-alone  data  Is  presented  In  table  19. 

Since  there  was  no  variation  In  the  fast-time  number  of  flights  handled  for 
RNAV,  Its  correlation  with  other  measures  could  not  be  estimated.  The  fast- 
time  distance  flown  and  time  In  system  are  highly  correlated  with  the  corres- 
ponding real-time  measures.  Figures  10,  11,  and  12  are  scatter  plots  Illus- 
trating this  correlation  for  the  one-sector  tests.  The  sample  correlations 
between  the  real-time  number  of  flights  handled,  the  fast-time  distance  flown, 
and  tlme-ln-system  measures  were  significant  and  negative.  After  examining 
the  data.  It  appears  that  this  was  a spurious  result  due  to  the  small.  Integer 
variation  in  the  number  of  flights  handled.  Communication  measures  were  i 

not  correlated  with  the  fast-time  measures.  [ 

i 

The  matrix  of  correlation  coefficients  Is  presented  In  table  20  for  the  Jet- 
VOR  data.  The  lack  of  correlation  between  the  fast-time  and  real-time  distance  [j 

flown  and  tlme-ln-system  measures  has  two  possible  causes.  The  variation  In  j 

these  measures  was  small,  and  several  real-time  measurements  were  substantially  !j 

higher  or  lower  than  the  other  measurements.  Figures  13,  14,  and  15  are  !j 

scatter  plots  of  time  In  system  and  distance  flown  for  the  one-sector  tests.  I 
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TABLE  17.  AVERAGE  OO^tlUNICATION  MESSAGE  BR£Aia)OVOIS  FOR  FIVE  SECTOR  CONFIGURATION 


Note. ' Time  le  measured  In  seconds  and  distance  in  nautical  miles 
Average  Is  on  a per  aircraft  basis  for  the  measure. 


TABLE  19.  CORRELATION  OF  FAST-  AND  REAL-TIME  MEASURES,  RNAV  CORRELATION  MATRIX 


THIRD  EXPECTED  RESULTS.  This  section  examines  the  relationship  of  controller 
workload  and  system  Impact  to  predetermined  quantities  of  potential  aircraft 
conflict  situations.  Regression  equations  were  fit  to  the  real-time  measures 
for  each  configuration,  with  potential  conflicts  (as  determined  In  fast-time 
simulations  of  the  same  traffic  samples,  route  structures,  and  geographic 
areas)  as  the  Independent  variable. 

The  regression  coefficient  would  be  nonzero  If  any  relationship  existed  between 
the  measure  and  the  number  of  potential  conflicts.  In  every  case,  the  regres- 
sion coefficient  was  not  significantly  different  from  zero.  Scatter  plots 
showing  the  performance  measures  plotted  versus  potential  conflicts  are  Included 
In  figures  16  through  24.  As  can  be  seen,  the  results  with  respect  to  the 
niiinber  of  potential  conflicts  did  not  demonstrate  any  consistent  trends. 

INCREASED  POTENTIAL  CONFLICT  SEPARATION  CRITERIA  EFFECT.  It  was  hypothesized 
that  the  correlation  between  potential  conflicts  and  the  real-time  measures 
was  obscurred  by  the  use  of  standard  conflict  separation  criteria.  In  order 
to  Investigate  this  possibility,  two  additional  horizontal  separation  criteria 
of  7 and  10  nml  were  tested.  The  computer  programs  were  rerun  for  the  single- 
sector fast-time  samples  to  obtain  the  number  of  potential  conflicts  under 
these  criteria.  The  results  are  shown  In  table  21. 


TABLE  21.  NUMBER  OF  POTENTIAL  CONFLICTS  FROM  INCREASED 
HORIZONTAL  SEPARATION  CRITERIA 


Sample 

5 nml 

7 nml 

10  nml 

Jet-VOR  1 

10 

16 

24 

6 

27 

34 

39 

10 

18 

27 

30 

RNAV  1 

4 

11 

13 

6 

8 

11 

11 

10 

3 

4 

9 

In  the  RNAV  samples,  the  first  and  sixth  samples  changed  places  In  order  of 
magnitude  when  the  separation  criterion  was  Increased  from  5 to  10  nml.  The 
relative  changes  In  the  number  of  potential  conflicts  were  not  substantial 
for  the  Jet-VOR  data.  Figures  25  through  32  Illustrate  the  relationships 
between  the  potential  conflicts  and  the  following  data  measures:  time  In 
system,  number  of  aircraft  handled,  total  talk  time,  and  average  contact 
duration.  The  differences  In  the  average  responses  between  the  RNAV  and 
Jet-VOR  results,  as  shown  In  the  scatter  plots,  are  due  to  differences  In  the 
traffic  densities  of  the  RNAV  and  Jet-VOR  saiiq)les.  Because  of  these  Inherent 
traffic  differences,  the  RNAV  and  Jet-VOR  results  were  analyzed  separately. 

As  can  be  seen,  the  real-time  measurements  appear  Independent  of  the  number 
of  potential  conflicts  for  either  separation  criterion.  No  correlation  was 
observed  between  potential  conflicts  and  the  representative  real-time  data 
measures  for  the  potential  conflict  separation  criteria  of  7 and  10  nml. 
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2-hour  data  period  compared  to  the  fast-time  simulation  teat  samples  herein 
show  no  real  difference  for  the  aggregate  of  these  measures. 

2.  The  number  of  potential  conflicts  generated  In  the  fast-time  tests  was 
[ significantly  greater  In  the  Jet-VOR  system  than  In  the  RNAV  system  In  tests 

of  both  the  one-  and  five-sector  configurations. 

REAL  TIME. 

1.  There  Is  a slgnlflceint  reduction  In  controller's  workload  (total  communi- 
cations time,  number  of  contracts,  and  number  of  control  Instructions  Issued) 
using  the  BNAV  system  versus  using  the  Jet-VOR  system.  In  this  respect,  the 
results  of  this  enroute  simulation  are  similar  to,  but  not  as  marked  as  those 
found  In  previous  terminal  area  simulations  which  compared  RNAV  to  non-RNAV 
terminal  area  environments. 

2.  Based  on  the  five-sector  data,  the  statistical  tests  do  not  substantiate 
a real  difference  between  the  Jet-VOR  and  RNAV  systems  for  real-time  tlme-ln- 
system  and  distance-flown  measures. 

3.  Controller  performance  and  system  user  measures  In  real-time  simulation  do 
not  demonstrate  any  consistent  trends  of  correlation  with  the  number  of  poten- 
tial conflicts  found  In  the  fast-time  simulations. 

4.  The  number  of  potential  conflicts  measured  for  a particular  route  struc- 
ture Is  very  dependent  upon  the  timing  and  altitude  profiles  of  aircraft 
In  the  traffic  sample.  In  real  life,  any  control  action  which  affects  the 
altitude  profile  or  effective  speed  of  an  aircraft  significantly  disrupts  the 
potential  conflict  situation  from  that  point  forward.  The  sensitivity  of  the 
potential  conflict  measure  to  control  changes  of  this  sort  reduces  the  possi- 
bility of  establishing  any  relationship  between  the  fast-time  potential 
conflict  measure  and  real-time  system  and  system  user  measures.  Therefore, 
little  useful  correlation  between  these  measures  was  found. 
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FIGURE  1.  SIMULATED  AREA  OF  CHICAGO  ARTCC 


FIGURE  2.  COMPOSITE  JET-VOR  ROUTES — FIVE  SECTORS 


FIGURE  3.  COMPOSITE  RNAV  ROUTES— FIVE  SECTORS 


FIGURE  4.  COMPOSITE  JET-VOR  ROUTES — ONE  SECTOR 


FIGURE  5.  COMPOSITE  RNAV  ROUTES — ONE  SECTOR 


FIGURE  6.  DIGITAL  SIMULATION  FACILITY  (DSF)  COMPUTER  SYSTEM 


FIGURE  7.  DS.F  PILOT  POSITIONS  AND  KEYBOARDS 
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FIGURE  8.  AIR  TRAFFIC  CONTROL  (ATC)  LARORATORY 
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FIGURE  9.  LABORATORY  CONFIGURATION 
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FIGURE  11.  FAST-TIME  TIME- IN- SYSTEM  VERSUS  REAL-TIME  DISTANCE  FLOWN  , PER  RUN,  RNAV~ONE  SECTOR 


FIGURE  12.  FAST-TIME  DISTANCE  FLOWN  VERSUS  REAL-TIME  DISTANCE  FLOWN,  PER  RUN,  RNAV— ONE  SECTOR 
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FIGURE  14.  FAST-TIME  TIME- IN-SYSTEM  VERSUS  REAL-TIME  DISTANCE  FLOWN,  PER  RUN,  JET-VOR—ONE  SECTOR 
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FIGURE  15.  FAST-TIME  DISTANCE  FLOWN  VERSUS  REAL-TIME  DISTANCE  FLOWN,  PER  RUN,  JET-VOR — ONE  SECTOR 
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POTENTIAL  CONFUCTS  I 

FIGURE  16.  AIRCRAFT  HANDLED  PER  RUN  VERSUS  POTENTIAL  CONFLICTS — ONE  SECTOR 
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FIGURE  17.  PUSH-TO-TALK  PER  RUN  VERSUS  POTENTIAL  CONFLICTS~ONE  SECTOR 
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FIGURE  18.  TOTAL  TALK  TIME  PER  RUN  VERSUS  POTENTIAL  CONFLICTS~ONE  SECTOR 
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FIGURE  20.  AVERAGE  NUMBER  OF  CONTACTS  PER  AIRCRAFT  VERSUS  POTENTIAL  CONFLICTS— .ONE  SECTOR 


FIGURE  21.  NUMBER  OF  CONTROL  MESSAGES  VERSUS  POTENTIAL  CONFLICTS—ONE  SECTOR 
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FIGURE  22.  AVERAGE  TALK  TIME  PER  AIRCRAFT  VERSUS  POTENTIAL  CONFLICTS— ONE  SECTOR 


FIGURE  23.  TIME- IN-SYSTEM  PER  RUN  VERSUS  POTENTIAL  CONFLICTS— ONE  SECTOR 
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FIGURE  24.  DISTANCE  FLOWN  PER  RUN  VERSUS  POTENTIAL  CONFLICTS — ONE  SECTOR 
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FIGURE  26.  TIME-IN-SYSTEM  PER  RUN  VERSUS  POTENTIAL  CONFLICTS,  lO-nmi  SEPARATION  CRITERIA 


FIGURE  27.  NUMBER  OF  AIRCRAFT  HANDLED  PER  RUN  VERSUS  POTENTIAL  CONFLICTS,  7-nml  SEPARATION  CRITERIA 


FIGURE  28.  NUMBER  OF  AIRCRAFT  HANDLED  PER  RUN  VERSUS  POTENTIAL  CONFLICTS,  10-nmi  SEPARATION  CRITERIA 


FIGURE  29.  TOTAL  TALK  TIME  PER  RUN  VERSUS  POTENTIAL  CONFLICTS,  7-:nml  SEPARATION  CRITERIA 
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FIGURE  30.  TOTAL  TALK  TIME  PER  RUN  VERSUS  POTENTIAL  CONFLICTS,  10-nmi  SEPARATION  CRITERIA 


APPENDIX  A 


REDUCTICm  OF  LINCOLN  LABORATOKt  DATA  TAPES/HIOl-ALTITUDE  RNAV 
TBAFFIC  SAMPLE  SELECTION 


The  Lincoln  Laboratory  data  tapes  covered  a 26-hour  period  and  accounted  for 
some  14,574  aircraft  flights  In  the  continental  United  States.  These  flights 
operated  both  In  the  lew-  and  hlgh~altltude  strata. 

Selected  hlgh-altltude  sectors  of  the  Chicago  (CHI)  ARTCC  conqtrlsed  the  simu- 
lated area  with  associated  geography  and  aircraft  density  obtained  from  data 
tapes  developed  by  Lincoln  Laboratory.  These  base  data  also  accounted  for 
routing,  fix  data,  type  of  flights  (l.e.,  departures,  arrivals,  and  overflights), 
and  type  and  weight  of  aircraft,  which  determined  aircraft  category  for  both 
RNAV  and  Jet-VOR  samples.  Aircraft  category  was  used  to  determine  the  air- 
craft's maneuvering  profile  for  rates  of  climb,  descent,  turn.  Indicated 
airspeed,  etc. 

Shown  In  figure  A-1  is  the  method  used  to  process  the  Lincoln  Laboratory  data 
tapes  to  the  DSF  computer  format  and  select  the  routes  that  entered  and 
departed  the  CHI  ARTCC 's  area.  To  reduce  the  number  of  computer  records  used 
to  store  the  selected  route  data  of  the  Jet-VOR  and  RNAV  systems,  points  along 
an  arbitrary  arc  of  450-nml  radius  from  Chicago  were  used  as  the  starting  points 
for  the  selected  entry  routes  which  originated  outside  this  arc. 

After  the  selection  of  the  Jet-VOR  and  RNAV  routes  (that  entered  the  five- 
sector  test  area)  was  made,  the  data  were  processed  further  to  Identify  routes 
that  were  matched  pairs  (considering  origin  and  destination  (figure  A-2) . 

Only  paired  routes  that  served  both  system  were  selected  for  the  simulation 
tests.  Those  routes  that  were  eliminated  were  nonetheless  sorted  on  tapes  for 
further  consideration.  After  ascertaining  the  specifics  of  the  test  program, 

It  was  discovered  that  the  traffic  density  was  too  low  to  be  representative  of 
traffic  that  would  be  realistic  for  controller  activity.  To  overcome  this, 

13  Jet-VOR  routes  (that  entered  the  test  area  without  paired  RNAV  routes) 
were  Introduced  as  RNAV  routes  for  the  RNAV  tests . 

No  RNAV  routes  were  substituted  Into  the  Jet-VOR  system.  The  rationale 
being  that  RNAV-equlpped  alrcreift  can  navigate  In  a Jet-VOR  route  system  while 
VOR-equlpped  aircraft  cannot  navigate  In  a RNAV  route  system. 

For  the  one-sector  configuration  tests,  a selection  of  routes  that  entered  the 
test  sector  was  made  from  the  five-sector  traffic  sample.  Also  deleted  were 
departure  routes  from  the  Chicago  terminal  area  that  cut  across  the  corners  of 
the  single-sector  test.  This  traffic  would  be  vectored  by  the  terminal 
controller  around  the  corners  prior  to  handoff  to  the  receiving  adjacent  sector 
controller  and  was  not  controlled  by  the  single-sector  controller  during  the 
five-sector  tests.  The  elimination  of  this  corner  traffic  had  no  effect  on  the 
number  of  potential  conflicts  for  the  test  sector. 
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FIGURE  A-1. 
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The  construction  o£  the  area  geometry,  route  loading,  route  segments,  fixes, 
aircraft's  Identification  and  flight  plan,  and  aircraft  category  was  obtained 
from  the  computer  storage  data  files,  stored  flight  plan  Information,  and  a 
classification  program  for  aircraft  category.  A partial  listing  of  each 
program  Is  shown  In  tables  A-1  through  A-5.  Reducing  this  from  magnetic  tapes 
required  considerable  progranmlng. 

File  1 contained  the  airport  pairs,  number  of  routes  available  between  the 
airports,  type  of  route,  and  usage,  as  shown  In  table  A-1. 

TABLE  A-1.  FILE  1,  DATA  TAPES,  ROUTE  INFORMATION 

Route  Identification;  Jet-VOR  or  RNAV 
Airport  Number  of  and  Route  Usage  Percentage 


Pairs 

Routes 

Route  Ident 

(%) 

LAS  ORD 

1 

HVOR921E 

100 

LAS  BOS 

2 

HVOR7354 

50 

HVOR7322 

50 

LAX  ORD 

3 

HVOR74C8 

10 

HVOR9859 

10 

HVOR74AD 

80 

LAX  ORD 

2 

LAXORDRl 

90 

LAX0RDR2 

10 

Legend: 

LAS  - Las  Vegas 

LAX  > Los  Angeles 

BOS  ~ Boston 

ORD  - Chicago  O'Hare 

File  2 contained  the  route  Identification  (Ident),  airport  pairs,  segment 
number,  and  segment  Ident,  as  shown  In  partial  listing  In  table  A-2. 


Route  Ident 
LAXBOSRl 

LAXORDRl 


TABLE  A-2.  FILE  2,  DATA  TAPES,  ROUTE  SEGMENTS 

Airport  Pair  Number  of  Segments  Segment  Ident 

4 


LAX  BOS 


LAX  ORD 


181C 
181B 
181A 
2 55 A 

00  7a 
00  7A 
C007 


LAX0RDR2 


LAX  ORD 
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3 


181C 

181B 

E007 


File  3 contained  the  latitude  and  longitude  lor  the  start  and  end  fix  of  each 
segment,  segment  length  in  nautical  miles,  number  of  route  segments,  and  route 
Ident.  Shown  In  table  A-3  Is  a partial  listing  of  file  3.  The  start  and  end 
points  defined  fixes  used  in  the  routes.  A program  changed  latitude/ longitude 
data  to  Cartesian  rectangular  coordinates  x and  y. 

TABLE  A-3.  FILE  3,  DATA  TAPES,  FIX  L0CATI(»1S,  AND  SEGMENT  LENGTH 


Common 


Segment 

Ident 

North 

Lat 

West 

Long 

North 

Lat 

West 

Long 

Length 

(nml) 

Route 

Segments 

Route 

Ident 

E007 

414221 

89U08 

413954 

903224 

60.86 

1 

LAX0RD2 

D366 

410057 

881501 

400219 

883131 

59.96 

1 

MEMORDRl 

POOS 

421857 

890955 

424215 

9025122 

60.37 

2 

MDWSFORl 

0RDSF03 

After  applying  the  same  algorithm  as  Lincoln  Laboratory,  aircraft  were  assigned 
to  the  selected  routes.  Table  A-4  shows  a partial  listing  of  the  flight  plan 
Information. 


TABLE  A-4.  FLIQIT  FLAN  INFORMATION 


True 

Air-  Alt  Pro- 


Flight 

Ident. 

User 

Type 

speed 

Cknots) 

Dept 

Arpt 

ft  X 
100 

Arr 

Arpt 

Spl 

Equip 

posed 

Time 

Weight 

(lbs) 

No 

N119K 

GA 

G159 

490 

OAK 

230 

LGA 

C 

1900 

35,100 

9867 

TW118C 

AC 

CV88 

477 

OAK 

330 

ORD 

C 

1630 

184,500 

9870 

UA232 

AC 

B727 

460 

OAK 

330 

ORD 

C 

1830 

153,000 

9871 

User  Is  by  type:  GA,  general  or  civil;  AC,  air  carrier;  M,  military 

Spl  Equip  Is  the  type  of  transponder  aboard  the  aircraft.  C Is 
4096  code  capability  transponder. 

No.  Is  the  Lincoln  Laboratory  flight  plan  number. 
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The  next  step  was  to  determine  the  aircraft  category  for  each  flight.  The 
aircraft  category  selected  the  appropriate  aircraft's  operating  profile  used 
by  the  DSF  programs.  Shown  In  table  A— 5 Is  the  method  used  to  cl^lsslfy  air- 
craft Into  categories.  Had  the  tests  Included  the  low-altitude  stratus,  a 
minimum  of  37  aircraft  categories  would  have  been  required. 


TABLE  A-5.  METHOD  TO  CLASSIFY  AIRCRAFT  CATEGORY 


Weight 


EnKlne(s) 

(lb) 

User 

CateKorv 

S,  M 

> 6,500 

GA 

1,  2,  3 

< 60,000 

AC 

2 

M 

> 60,000 

AC 

4,  5,  6 

<155,000 

GA 

M 

>155,000 

AC 

7,  8,  9 

<300,000 

GA 

H 

>300,000 

AC 

10,  11,  12 

GA 

simulation  12 

aircraft  categories 

were  used. 

Rather  than  : 

the  number  of  categories  so  that  each  aircraft  had  Its  own  profile,  arrival 
and  overflight  aircraft  entered  the  problem  at  filed  true  airspeed  rather  than 
profile  speed.  This  program  change  of  profile  cruise  speed  to  filed  speed 
gave  each  aircraft  Its  own  true  airspeed.  Departure  flights  reaching  cruise 
altitude  (filed  In  flight  plan)  would  cruise  at  filed  true  airspeed.  Thus, 
computer  core  space  was  available  for  other  programs. 


Using  the  aircraft  profile  assigned  by  category,  a computer  program  calculated 
the  aircraft's  time  at  the  450-nml-radlus  arc  from  CHI.  From  here,  the  air- 
craft were  advanced  to  the  fix  prior  to  the  sector  boundary.  This  fix  then 
became  the  start  point.  The  time  at  the  start  point  was  used  by  the  DSF 
computer  program  to  activate  the  aircraft  In  the  simulation  tests.  This 
accounted  for  all  arrival  and  overflights  that  would  operate  within  the  five 
sectors  of  Interest.  Added  to  those  flight  were  the  departures  within  the 
five  sectors. 


To  Insure  high  traffic  density,  a computer  program  was  used  to  determine 
the  peak  2 hours.  Added  were  aircraft  that  would  enter  the  area  1 hour 
prior  to,  and  1/2  hour  after  this  peak  period.  This  then  became  the  master 
traffic  sample.  Figure  A-2  defines  the  events  and  Is  shown  under  step  1. 


A-6 


After  the  selection  of  Jet-VOR  and  BNAV  routes  for  the  teat  area,  a delete 
function  was  made  for  routes  which  had  no  equivalent  (paired)  Jet-VOR  or  RNAV 
route.  Since  there  were  more  Jet-VOR  routes  without  a paired  RNAV  route.  It 
was  necessary  to  use  a few  of  the  Jet-VOR  routes  (approximately  13)  In  the 
RNAV  route  system  to  Insure  sufficient  traffic  density  In  both  system  tests. 
The  rationale  for  using  the  Jet-VOR  route  system  was  that  RNAV-equlpped  air- 
craft can  navigate  on  a VOR  route  while  the  opposite  cannot  be  done. 

Shown  in  figure  A-2,  step  2,  was  the  method  to  modify  the  geographical  data 
for  use  In  the  DSF  programs. 
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r 


TRAFFIC  SAMPLE  COMPOSITION 


Shown  In  table  R-1  la  the  general  compoaltion  of  aircraft  flights  that  operated 
In  the  Jet“VOR  and  RNAV  tests  for  the  five-  and  one-sector  simulations.  The 
tabulation  depicts  airport  operations  (arrivals,  departures,  and  within)  and 
overflights.  The  airports  listed  are  in  the  test  area  or  adjacent  to  the  test 
area.  Adjacent  airports'  operations  are  summarized  for  departure  flights 
only.  Within  flights  are  those  that  departed  an  airport  in  the  test  area  or 
an  adjacent  airport  and  arrived  at  an  airport  within  the  test  area.  Within 
flights  are  accounted  for  by  departure  airport  with  the  destination  airport 
shown  next  to  the  operation  count.  The  operations  for  Midway  and  O'Hare 
airports  are  itemized  for  departures  and  arrivals,  since  these  airports  genera- 
ted a majority  of  the  test  area's  traffic.  Overflights  are  flights  which  did 
not  depart  or  arrive  at  an  airport  in  the  test  area. 


TABLE  B-1.  MATRIX  BOR  SAMPLES 


Five  Sectors 


Airport 

Arrivals 

Departures 

Within 

Overflights 

Cedar  Rapids  (CID) 

2 

2 

1-ORD 

122 

Des  Moines  (DSM) 

2 

2-ORD 

Dubuque  (DBQ) 

1 

1 

Midway  (MDW) 

9 

3 

Milwaukee  (MKE) 

4 

5 

O' Hare  (ORD) 

53 

89 

3-CID 

Peoria  (PIA) 

2 

Tota- 

71 

102 

6 

122 

One  Sector 

Airport 

Arriveds 

Departures 

Within 

Overflights 

Cedar  Rapids  (CID) 

1-ORD 

26 

Des  Moines  (DSM) 

1 

2-ORD 

Dubuque  (DBQ) 

1 

1 

Midway  (MDW) 

4 

2 

Milwaukee  (MKE) 

3 

O'Hare  (ORD) 

13 

23 

3-CID 

Total 

18 

30 

6 

26 

Note:  The  above  matrices  for 

traffic  samples  are 

a summary 

of  total  count  of 

aircraft  operations  which  includes:  buildup,  data, 

) and  end  periods.  Shown  in 

figure  1 is  the  location  of  each  airport. 
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APPENDIX  C 


RECORDED  DATA  PER  RUN 


The  data  in  tables  C-1  and  C-2,  appendix  C,  are  sunmarles.  There  are  four 
types  of  routes;  enroute,  transition,  approach,  and  final.  The  Item  recorded 
under  routes  would  record  the  type  of  route  that  the  aircraft  was  on. 

Table  C-1  contained  19  Items,  and  table  C-2  contained  54  Items. 


TABLE  C-1.  DATA  RECORDED  PER  RUN 

t 

k 

1.  Route — type  of  route 

2.  Fixes — X and  y coordinates,  name,  type 

3.  Problem  start  time  In  seconds 

4.  Common  areas  between  digital  displays 

5.  Number  of  digital  displays. 


TABLE  C-2 


DATA  RECORDED  PER  SECOND 


1.  Time  in  seconds — reference  to  24-hour  clock 

2.  Largest  ntimber  of  aircraft  at  any  one  time  in  test  area 

3.  Communication  lines — number,  duration  and  block  time 

4.  X,  y,  and  z,  i.e.,  aircraft's  grid  coordinates  and  attitude 

5.  Aircraft  heading — radians 

6.  Desired  climb  and  descent  rate,  feet  per  second 

7.  Next  fix — x,y — aircraft  homing 

8.  Last  offset  point  (x,y),  aircraft  on  offset 

9.  Next  offset  point  (x,y),  aircraft  on  offset 

10.  Offset  distance — nautical  miles 

11.  RNAV  status — aircraft  enroute  simulation  are  similar  to, 

12.  RNAV  equipment  code 

13.  Crossing-altitude  restrictions — route  or  clearance 

14.  Previous  altitude  assigned 

15.  Station  VOR  or  fix — x,y 

16.  Measured  x,y  from  station  or  fix 

17.  Groundspeed,  nautical  miles  per  second 

18.  Aircraft  identification — call  sign 

19.  Aircraft  turn  rate — radians  of  change  per  second 

20.  Aircraft  speed  delay — seconds  prior  to  speed  change 

21.  Aircraft  heading  delay — seconds  prior  to  heading  change 

22.  Aircraft  altitude  delay — seconds  prior  to  altitude  change 

23.  Desired  heading  turning  to — radians 

24.  Indicated  airspeed — nautical  miles  per  second 

25.  Bearing  to  next  fix — radians 

26.  Distance  to  next  fix — nautical  miles 

27.  Last  fix  and  next  fix — x,y  coordinates 

28.  Aircraft  tracking  x,y,z  as  determined  by  radar  sweep 

29.  Climb  rate — feet  per  second  per  second 

30.  Acceleration/deceleration  rate — nautical  miles  per  second  per  second 

31.  Desired  speed — airspeed  change — nautical  miles  per  second 

32.  Aircraft  status — in  or  out  of  problem,  turning,  climbing, 

accelerating,  etc. 

33.  Flight  plan  indicator- aircraf t 's  position 

34.  Aircraft  type — B707,  etc. 

35.  Requested  altitude — reference  from  flight  plan 

36.  True  airspeed — nautical  miles  per  second 

37.  Pilot  number /simulator  number  cross  reference — simulator  number 

assigned  to  each  flight  usually  by  lowest  entry  first,  etc. 

38.  Controller/pilot  assignment 

39.  Pilot/controller  messages — control  messages  by  type  (turn,  climb, 

etc.)  Issued  by  each  controller 

40.  Pilot  number  per  aircraft — instantaneous  count  of  aircraft  assigned  to 

each  pilot. 
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APPENDIX  D 


USE  OF  A PERMUTATION  DISTRIBUTION  OF  x FOR  TESTING  IF  AN  ADDITI(»IAL 
SAMPLE  POINT  IS  A MEMBER  OF  A PRIMARY  SAMPLE  DISTRIBUTION 

Reference  3 (page  489)  demonstrates  that  the  sample  statistic 

w - n (X  - X (1) 

112 

n2  s2 

where: 

nj^  = Size  of  sample  1 
n2  ~ Size  of  sample  2 
Xi  » Average  for  sample  1 
X2  Average  for  sample  2 

s2  s Variance  for  the  combined  samples 
is  distributed 


w 


- 1 + n^l 

.2 


(2) 


where: 

n ■ n2^+n2  ■ nj^+1 

t - Students'  t values  for  n-2  degrees  of  freedom 

For  this  application,  the  combined  sample  variance  S can  be  expressed  in  terms 
of  the  primary  sample  variance  and  the  value  for  the  additional  point. 


(n+l)s2  - r x^+y2 
1-1  1 


n 2 

(Z  X+Y)'^ 
i-1  1 

n+1 


(3) 
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where : 


S - Variance  of  the  primary  saiq>le 
1 

n ■ 

Y - X2  * Additional  sample  point 
> Members  of  primary  sample 

Equation  3 can  be  reduced  to 

(n+DS^  = nS^  + _n_  (X-Y)^  (4) 

n+1 

Solving  (2)  for  t yields 

t^=  (n-l)w  (5) 

1-w 

Substituting  (1)  and  (4)  Into  (5)  gives 


This  value  can  be  used  to  test  the  hypothesis  that  the  additional  point  Y can 
be  considered  as  a member  of  the  same  parent  distribution  In  which  the 
primary  sample,  X,  was  driven. 
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